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Abstract. We give a priority queue that achieves the same amortized 
bounds as Fibonacci heaps. Namely, find-min requires 0(1) worst-case 
time, insert, meld and decrease-key require 0(1) amortized time, and 
delete-min requires O(logn) amortized time. Our structure is simple 
and promises an efficient practical behavior when compared to other 
known Fibonacci-like heaps. The main idea behind our construction is 
to propagate rank updates instead of performing cascaded cuts following 
a decrease-key operation, allowing for a relaxed structure. 



1 Introduction 

The binomial queue |23| is a basic structure that supports the operations: find- 
min in 0(1) worst-case time, insert and meld in 0(1) amortized time, decrease- 
key and delete-min in O(logn) worst-case time. It can also be extended to sup- 
port insert in 0(1) worst-case time. Being so natural, simple and efficient, bi- 
nomial queues do exist in most introductory textbooks for algorithms and data 
structures; see for example [3]- 

Realizing that many important network-optimization and other algorithms 
can be efficiently implemented using a heap that better supports decrease-key, 
and that improving the bound for decrease-key is theoretically possible, Fredman 
and Tarjan [llj introduced Fibonacci heaps supporting the operations: find- 
min in 0(1) worst-case time, insert, meld and decrease-key in 0(1) amortized 
time, and delete-min in 0(log n) amortized time. Using Fibonacci heaps the 
asymptotic time bounds for many algorithms have been improved; see 

Around the same time, Fredman et al. introduced the pairing heaps [TO] . 
a self-adjusting alternative to Fibonacci heaps. They only established O(logn) 
amortized time bound for all operations. Stasko and Vitter [2T] improved the 
amortized bound for insert to 0{1). They also conducted experiments showing 
that pairing heaps are more efficient in practice than Fibonacci heaps and than 
other known heap structures, even for applications requiring many decrease-key 
operations! More experiments were also conducted }17j illustrating the prac- 
tical efficiency of pairing heaps. The bounds for the standard implementation 
were later improved by lacono jH] to: 0(1) per insert, and zero cost per meld. 
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However, Fredman ^ showed that pairing heaps is not theoreticahy as efficient 
as Fibonacci heaps by giving a lower bound of J?(loglogn), and precluded the 
possibility of achieving 0(1) decrease-key unless every node carries J?(loglogn) 
information bits. Later, Pettie (19; improved the analysis for the decrease-key 
operation to achieve 0(2^v''°s logn-j amortized bound. Recently, Elmasry [S] in- 
troduced a variant with O(loglogn) amortized bound per decrease-key. 

Towards a heap that achieves good worst-case time bounds, Driscoll et al. [4] 
introduced the relaxed heaps. The rank-relaxed heaps achieve the same amor- 
tized bounds as Fibonacci heaps, and were easily extended to the run-relaxed 
heaps that achieve the bounds in the worst case except for meld. Relaxed heaps 
are good candidates for applications with possible parallel computations. Still, 
relaxed heaps are not practically efficient and are more complicated than Fi- 
bonacci heaps (they are not actually relaxed from this prospective). Another 
priority queue that achieves the same worst-case time bounds as run-relaxed 
heaps is the fat heap [16]. Incorporating 0(1) worst-case meld to the repertoire 
of operations, Brodal [2] introduced a priority queue that achieves the same 
bounds as the Fibonacci heaps, but in the worst-case sense. Brodal's structure 
is impractical and even more complicated than relaxed heaps. 

Several attempts were made |13I15I18I22 I to come up with a priority queue 
that is theoretically as efficient as Fibonacci heaps without sacrificing the practi- 
cality. Among those, we find thin heaps [151 the most natural and promising. In 
spite of being able to improve the space requirements by getting rid of the parent 
pointers jl5l22| . or equivalently by using a binary-tree implementation [13118] . 
the practicality issue is not resolved yet (or at least that is our impression!). 

In this paper we claim that we resolved this issue by introducing a priority 
queue that we call the violation heap. Violation heaps have the same amortized 
bounds as Fibonacci heaps, and are expected to perform in practice in a more 
efficient manner than other Fibonacci-like heaps and compete with pairing heaps. 
Our amortized bounds are: 0(1) per find-min, insert, meld and decrease-key, 
and 0(log n) per delete-min. In contrary to other Fibonacci-like heaps, while in 
agreement with pairing heaps, the degree (number of children) of a node in the 
violation heaps is not necessarily logarithmic in the size of the subtree of this 
node; in fact there is no bound on node degrees, allowing what we call a relaxed 
structure. (Still, for the purpose of the analysis, the number of children of a node 
is amortized towards both the delete-min and decrease costs.) 

For Fibonacci heaps and thin heaps the degree of a node is bounded by 
pa 1.44 Ign, and for 2-3 heaps [H] and thick heaps [TS] the bound is Ign. Ensuring 
a larger degree bound (or even no bound) is not necessarily a disadvantage 
though; it only indicates how much relaxed the structure is. The reason is that 
a tighter degree bound may require more effort to restrict the structure to such 
bound. As an alibi, no such degree bound is guaranteed for pairing heaps [TO] . 
Similar arguments can be mentioned about the bound on the height of a splay 
tree [50] versus that of an AVL [T] tree. In addition, one can resort to known 
techniques [718] to reduce the number of comparisons performed in a delete-min 
operation almost by a factor of two. 



In the next section we give our motivation: why there is a need for a new 
structure, what our objectives are, and how to achieve them. Then we introduce 
the data structure: design, operations and time bounds. Finally, we conclude the 
paper with some comments. 

2 Motivation 

In this section we argue why we need a new Fibonacci-like heap structure. We 
start with the drawbacks of other such heaps. Then, we summarize our objectives 
and the features required for a better heap structure. We end the section with 
ideas that lead to the violation heaps. 

Draw^backs of other structures 

The pairing heap [TU] is the most efficient among other Fibonacci-like heaps from 
the practical point of view [17121] . Still, it is theoretically inefficient according 
to the following fact [5]. 

— The amortized cost per decrease-key is not a constant. 

In contrary to pairing heaps, all known heaps achieving a constant amortized 
cost per decrease-key |4I11I13I15I18I22) impose the following constraint, which 
makes them practically inefficient. 

— Every subtree has to permanently maintain some balancing constraint to 
ensure that its size is exponential with respect to its height. 

The Fibonacci heaps ll\ have the following drawbacks. 

— Every node has a parent pointer, adding up to four pointers per node. 

— A subtree is cut and its rank decreases when its root loses two of its children. 
If the subtrees of these two children are small in size compared to the other 
children, the cascaded cut is immature. The reason is that the size of this cut- 
subtree is still exponential in its rank. This results in practical inefficiency 
as we are unnecessarily losing previously-gained information. 

— The worst-case cost per decrease-key can be 0{n); see [3] exercise 20.4-1]. 

Being able to remedy the drawbacks of Fibonacci heaps, other heap structures 
have not yet achieved the goal though! The trend of imposing more-restricted 
balancing constrains on every subtree would result in the following pitfalls that 
accompany a decrease- key operation |13ll5ll8l22j . 

— More cuts resulting in the loss of gained information. 

— More checks among several cases resulting in performance slow down. 

The rank-relaxed heaps [1] is even more restricted, allowing for no struc- 
tural violations but for only a logarithmic number of heap-order violations. This 
requires even more case-based checks accompanying decrease-key operations. 



Objectives for a new design 

To avoid the above drawbacks, we need a heap with the following properties. 

— No parent pointers. 

— Structural violations in the subtrees of small children do not matter. 

— No cascaded cuts, and in accordance allowing a relaxed structure. 

— Fewer case-based checks following a decrease-key operation. 

Insights 

The main intuition behind our design is to allow structural violations resulting 
from decrease-key operations, and only record the amount of violations in every 
subtree within the root node of this subtree. We rely on the following three ideas: 

The first idea, which kills two birds by one stone, is to only consider violations 
in the first two children of a node (one child is not enough) . As in [TS] , we utilize 
the unused left pointer of the last child to point to the parent. This makes it 
easy to convey such violations to a parent node without having a parent pointer. 

The second idea, which we have recently used to improve the amortized cost 
of the decrease-key operation for pairing heaps to O (log log n) [5], is not to cut 
the whole subtree of a node whose key is decreased. Instead, we replace such 
subtree with the subtree of the last child. The expectation is that the size of 
a last-child's subtree constitutes a constant fraction of that of the parent, and 
hence the resulting structural degradation will be smoother. We also reduce the 
lost information resulting from the cut by keeping a good portion of the subtree. 

The third idea is about how to record the violations. As a compensation 
for the structural violation it has done, a decrease-key operation can pay 1/2 
credit to its parent, 1/4 credit to its grandparent, and in general 1/2' to its i-th 
ancestor. Once the credits in a node sum up to at least 1, we declare its subtree 
as violating. Later, the fix of this violation can be charged to this credit. As long 
as the credits on a node are still less than 1, its subtree is maintaining a good 
structure. The question is how to implement this idea! The details follow. 

3 The violation heaps 
Structure 

Similar to Fibonacci heaps, 2-3 heaps and thin heaps, the violation heap is a set 
of heap-ordered node-disjoint multiary trees. The children of a node are ordered 
according to the time when they are linked to the parent. Every node has three 
pointers and one integer in addition to its key, utilized as follows. 

a. A singly-linked circular list of tree roots, with a root of minimum key first. 

b. A doubly-linked list of children for each node, with a pointer to its last child. 

c. For each last child, the unused pointer points to its parent. 

d. An integer for each node representing its rank. 



We maintain the invariant that the size Sz of the subtree of a node z is 
exponential with respect to its rank r^, but not with respect to its degree dz- 
The violation Vz of a node z indicates how bad the structure of its subtree is, 
and is defined in terms of and dz as 



We emphasize that we only store Vz, but neither dz nor Vz- The notion of 
violations is only used in the analysis, but not in the actual implementation. 

In the sequel, we call a node active if it is one of the last two children of 
its parent. We maintain the rank of a node z, in accordance with Lemma [21 by 
updating once the rank of any of its active children r^i and rz2 decreases. We 
use the following formula: 



Evaluating this formula requires an integer addition, a right shift, and one or 
two increments. If z has one or no children, the rank of a missing child is —1. 
The following primitive is used to consolidate the trees of the heap. 

3-way-join{z, zl, z2) (the presumption is that = rzi — rz2)' 

Assume w.l.o.g. that z's value is not larger than that of zl and z2. Ensure 
that the active child of z with the larger rank is the last child. Make zl and 
z2 the last two children of z by linking both subtrees to z, and increment r^. 

Operations 

— find-min(h): Return the first root of h. 

— insert(x,h): A single node x is inserted into the root list of h. The rank of 
X is initially set to zero. If the key of x is smaller than the minimum of h, 
then X is inserted in the first position, otherwise in the second position. 

— meld(hi,h2)'. The root lists of hi and /12 are combined in a new list whose 
first root is the smaller between the minimums of the two heaps. 

— decrease-key (6 ,x,h): Subtract 6 from the key of x. If x is a root, stop after 
making it the first root if its new value is smaller than the minimum. If x is 
an active node whose new value is not smaller than its parent, stop. 
Otherwise, cut the subtree of x and glue in its position the subtree with 
the larger rank between its active children. Recalculate the rank of x using 
P^. Promote x's subtree as a tree in h, and make x the first root if its new 
value is smaller than the minimum. Propagate rank updates by traversing 
the path of ancestors of cc's old position, as long as the visited node is ac- 
tive and as long as its recalculated rank using ^ is smaller than its old rank. 




otherwise. 




rz ^ \{rzi^rz2)l2\ + 1. 



(1) 



— delete-min(h): Remove from h the first root and make eacfi of its subtrees a 
tree in h. Repeatedly 3-way-join trees of equal rank until no three trees of 
the same rank remain. As for Fibonacci heaps [IT, this is done in 0(1) time 
per tree using a temporary array indexed by rank values. Finally, the root 
with the new minimum value is moved to the first position in the root list. 



First, we point out that 3-way-join is favorable to the normal join for our case. 

Lemma 1. No extra violation units are added to the nodes of the heap as a 
result of a 3-way-join. 

Proof. Consider the 3-way-join(z, zl, z2) operation, assuming that the value of 
z is not larger than the values of zl and z2. When z gains two extra children, 
Tz is incremented ensuring that dz/2 — r^ does not change. □ 

Next, we show that the assigned rank values fulfill the requirements. 
Lemma 2. The following relations are maintained for every node z. 



Proof. When a node z is inserted is set to 0. When a subtree of a node x is 
cut by a decrease-key operation, the ranks of the ancestors of x are updated by 
traversing the affected path upwards. As long as the violation of the nodes on 
the path is to be increased (rank should decrease), the decrease-key operation 
resumes the upward traversal and decreases the rank. Once the rank of a node is 
not to be changed, the rank of the other nodes along the path are already valid. 
For the case when the new rank is more than the old value no updates are done. 

When an active child vanishes, as a result of repeated decrease-key opera- 
tions, another child (if there exist any) becomes active. This would make the 
inequalities given in the statement of the lemma satisfied as strict " <" , and the 
recalculated rank is now larger than the rank stored in the parent. In such case, 
no rank updates are done and the upward traversal is terminated. 

Consider the 3-way-join(z, zl, z2), assuming that the value of z is not larger 
than the values of zl and z2. Before the join, = r^i = rz2- After the join, zl 
and z2 become the active children of z implying that -s— [(r^i -I- rz2)/2] + 1. 
This explains the validity of incrementing after the join. 

If z has one or no children, the lemma analogously follows by assuming the 
rank of a missing child to be —1. □ 

The following two lemmas are used in the proof of Lemma [S] and Theorem [TJ 



Analysis 




Lemma 3. Consider any node z. Let zl and z2 be the active children of z, such 
that rzi > rz2- Then, either 

a. r^i > r^, or 

b. Tzi = Tz — 1 and r^-i = — 1 or — 2. 

Proof. Using < [(^'21 + '"z2)/2] + 1 from Lemmas then r^ < rzi + 1. Consider 
the case when r^i = — 1. It follows that < [(r^ — 1 + rz2)/2] + 1, which 
implies rz2 > rz — 2. But rz2 < Tzi, indicating that rz2 equals — 1 or — 2. □ 

Lemma 4. The rank of any node can be decreased by at most 1 when propagating 
rank updates within a decrease-key operation. 

Proof. When a decrease- key is performed on a node z, the subtree of zl is 
promoted in its position. From lemma [Sj rzi ^ fz — ^ implying that we now 
have a node that may be less in rank but by at most 1, and the lemma holds. 
Propagating the rank updates using ([Ij would result in a decrease of 1 in the 
rank of the parent node, if at all any. □ 

The above lemma is important and worth commenting. A crucial observation 
is that the parity of the ranks of the active children of a node affects the possibil- 
ity of updating its rank. From Lemma[2l if the sum of the ranks of the two active 
children is even and one of them is decremented, then the rank of the parent is 
not to be changed. If this sum is odd and one of the two ranks is decremented, 
then the rank of the parent may be decremented. Another consequence is that 
the sum of the violation units added to the heap nodes is bounded above by the 
number of rank-update steps performed within the decrease-key operations. 

Now, we prove the structural lemma, illustrating that the size of a subtree is 
exponential with respect to its rank. 

Lemma 5. Let Sz be the size of the .subtree of any node z, and rz be its rank. 
Then Sz > Fr^, where Fi is the ith Fibonacci number. 

Proof. If z has no children, then rz — Q and the lemma holds. If z has one child 
that is a leaf, then = 1 and Sz = 2 and the lemma also holds. If z has one 
child whose rank rzi > 0, then < [(r^i — l)/2] -I- 1 implies r^i > r^. Using 
induction, Sz > fr^i > Fr^. If z has at least two children, while r^i > the 
bound follows as above by induction. Using Lemma O the possibility left is that 
fzi = ^ 1 and rz2 ^ rz — 2. Again using induction, then 

Sz > Fr^^ + Fr^2 ^ + Fr^-2 — Fr^. 

a 



Corollary 1. For any node z, rz — O(logSz). 



Finally, we prove the main theorem concerning the time bounds for the op- 
erations of the violation heaps. 

Theorem 1. The violation heaps require 0(1) amortized cost per find- min, in- 
sert, meld, and decrease-key; and O(logn) amortized cost per delete-min. 

Proof. An active node is called critical if the sum of the ranks of its active 
children is odd. As a consequence of Lemma IH the decrease-key terminates the 
upward traversal for rank updates when it reaches 

a. a nonactive node, or 

b. an active noncritical node (which becomes critical), or 

c. a critical node whose rank is not to be changed (the current value is not 
larger than the recalculated value) . 

Let 7 be the number of critical nodes in the heap. Let be the sum of 
violation units on the nodes of the heap, i.e. ■& = ^y^i'^z = dz/2 — rz). Let 
T be the number of trees in the heap. Let be the number of decrease-key 
operations, since the 3- way-join in which z was linked to its current parent, 
which have terminated at one of the two nonactive siblings of z that were active 
just before the join. Let A — X^vz potential function 

P = 37 + 2t? + T + Z\. 

The actual time used by find-min, insert, and meld is 0(1). Both find-min 
and meld do not change the potential, and an insertion increases r by 1. It 
follows that the amortized cost of these operations is 0(1). 

We call the path traversed by the decrease-key operation to perform rank 
updates the critical path. The decrease-key uses 0(1) time plus the time it tra- 
verses the critical path. The crucial idea is that every node on this path was 
critical and becomes noncritical after the traversal. In addition, the increase in 
violation units precisely equals the number of such nodes. Let k be the number 
of nodes on a critical path. Then the actual time used by the decrease-key op- 
eration is 0{k). On the other hand, 7 decreases by at least k — 2 (the cut node 
itself may also become a critical root), increases by k, r increases by 1, and A 
may increase by 2 (in that case 7 decreases by k — 1). Accordingly, the change 
in potential is at most — 3(fc — 2) + 2fc + 1 = — fc + 7. These released k credits 
pay for the 0{k) work done by the decrease-key, which only pays the 7 credits. 

When the subtree of a node z is cut and becomes a tree root after losing its 
last child zl (which is glued in its position), the rank of z is updated and may 
decrease, raising the need for more violation units. In such case, we claim that 
the increase in 2i? is at most the decrease in A plus 2; these 2 credits are also 
paid for by the decrease-key operation. To prove our claim, consider the moment 
following a 3- way-join linking zl to z. Let r be the rank of zl, then the rank 
of z is r -I- 1 . From Lemma [31 the rank of its third-to-last child (whose rank is 
enforced to be larger than that of the fourth-to-last child) is at least r — 1. When 
z is cut and loses its last child zl, the third-to-last child of z before the cut now 
becomes active with rank say r' . 11 r' > r, the rank of z does not decrease and 



we are done. Otherwise, the decrease in the rank of z, which equals the increase 
in "d, is at most (r — r' + l)/2. On the other hand, A^i must have been at least 
r — r' — 1 and is now reset to zero. Then, the increase in potential is at most 
2(r - r' + l)/2 - (r - r' - 1) = 2, and the claim follows. 

The preceding two paragraphs imply that the amortized cost for the decrease- 
key operation is 0(1). 

The 3-way-join uses 0(1) time, and decreases r by 2 resulting in a release 
of 2 potential credits, which pay for the work. Note that the normal join may 
result in the root of the joined tree being critical, requiring more credits (that 
is the reason we resort to 3-way-join). In addition, from Lemma [l] no violations 
are added accompanying the 3-way-join. 

Consider a delete-min operation for node z. When the children of z become 
new trees, r increases by dz and ?? decreases by Vz > dz/2 — r^. Therefore, the 
change in potential is at most 2rz, which is O(logri) by Lemma [5] Finding the 
new minimum requires traversing the roots surviving the consolidation, whose 
count is at most twice the distinct ranks because at most two roots per rank re- 
main. It follows that the amortized cost for the delete-min operation is O(logn). 

□ 

4 Comments 

We have given a priority queue that performs the same functions as a Fibonacci 
heap and with the same running-time asymptotic bounds. The main feature of 
our priority queue is that it allows any possible structure, with no structural 
restrictions soever, but only records the structure violations. Our priority queue 
uses three pointers and an integer per node. Following a decrease-key operation, 
we retain as much information as possible by not performing cascaded cuts and 
by keeping a big chunk of the subtree of the decreased node in its place. We 
expect our priority queue to be practically efficient. Experimental results still 
need to be conducted to support our intuitive claims. 

In comparison with other Fibonacci-like heaps, a drawback of violation heaps 
is that it cannot be implemented on a pointer machine. Indeed, we need the 
power of a RAM to recalculate the ranks using formula ([T|), which involves 
integer addition and bit operations. 

Independently, and after the first technical-report version of this paper [5] 
(which is to-an-extent different from the current version) was archived, the idea of 
performing rank updates instead of cascaded cuts appeared in [12 . The structure 
in [12j . which is called rank-pairing heaps, relies on half-ordered half trees and 
not on multiary trees. Also, the way the rank updating mechanism is performed 
in [12] is different from that in violation heaps. 
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